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•this two volume irejiort describes the Training Requirements 
. Analysis Model (T|lAMOb). Volume I describeiS' its development and 
composition. Volume II is a us6^*s guide to its operal^on and 
specificfittiOrK^ The reporjt is one of a series of technical reports^ > 
models, and data banks j^roducjad under contract noi F336r5r75-C- 
,,5218^ ''DAIS Life Cycle Costing'Studj;, " This study, in combination 
with present Air Force capabilities/ will provide the means tp assess ^ 
ihe l^e cycle cost «Bp€fcTof .tfre, operational implementatien of the 
Digital Avionics Information System (DAIS).. • ^ 

The stv0y was directed by the Advanced Systeijis Division, 
V, Air Force Human Resources Laboratory, Wright- Patterson Air. 
V Force Base, Ohio, and is docximented under Wo rk^ Unit 2051-00-01, 
"DAIS Life Cycle Costing Study. " It was perfornfed under Air Force 
Avionics Laboratory Program Element 63 243F,/"Digital Avionics 
Infc^rmati&n System," Project 2051. Project 20&1, "Impact of DAIS \ 
on Life Cycle Costs, " is jointly sponsored by- the Air Force'liuman 
Resources Laboratory and the Air Force Avionics LabpratoryJ both of 
the Air Force Systems Command, and by the Air Force Lo^stics 
Command. Contract funds were provided by the Air Force.^**onics . 
Labbratory. The DAlS"Program Majiager'^is^Lt. Col. Robert A. 
Dessert. The Air Force Him^an Resources Laboratory Project 
Scientist is Mr. H. Anthony' paran. The Air Force Logistics 
Command Project Officer is Captain Ronald Hahn.* Jhe latter two 
are DAIS Deputy Directors, ^he Contractor Program Manager is * . 
Mr. John Goclowski. • ^ ' 



J '• 



SUMMARY 

BACKGROUND • . 

ThisJ-wo volume report is one of a series of technical 
r-eports which describe products of the Digital Avionics Information 
System (DAIS) life Cycle Cost (LCC) Study. That s^dy supports - 
the DAIS advanced development program, which is developing and 
testing a concept of integrated avionics as an information manage- 
ment system. Implementajtion of that concept in Air Force weapon 
systems is expected to h^^ve significant impacts pn their LCC and 
system support requirements. T^e DAIS LCC Study w^s undertaken 
to advance the current technology for identifying and quantifying 
such impacts. Volume Ope of th>S7^eport describes one of the 
results: a model for analyzingkthe pxxtential impact. of weapon p 
system design on p^er^sonnel training requirements. Volume Two 

provides detailed guidance in its use. ^ # 

% - - 

' ' - * * r . 

A number of te'chniques have been successfully ^applied -to the 
quantUartive s^nalysi^ of weapon. system support personnel require- 
ments. Thete is a^need, however, for means -to evaluate the qualita- 
tive aspect of These requirements, i. e. , the training requirements 
which they generate. The analysis of training impacts within the 
design process is an absolute necessity if weapon fiTystems are^ to be 
designed to provide essential capability at an affordable cost. Part 
of the DAIS LCC Study was addressed to the provision of a technique 
for meeting this need. 

OBJECTIVES ' 1 . ' 

• / The objectives of the effort described in^his report werA 
twdiold: (1) to provide a means fbr analyzing the training require- 
' mints' generated by new weapoil systems which cpul^ applied tb 
estimate potential impacts of the dAiS, and (2) to provide the data 
ijecessa^^y for appflLication of the results to the DAIS. 

./ ^ 

/APPROACH ^ 

/ ' A literat^ure search w^ undertaken to determine the avail- 
ability of anr, analytic tool which could be used to snodel the training 
requirements of a. DAIS application. The results inc^icated that no 
such, capability existed/ Therefore it was ne.cessary 'tp develop a 
model to evaluate tasks associated with eq'uipment maintenance in 
terms of the training options availkble'for preparing personnel to 

- perform those tasks."" The principal guidelines for themodel con- 
struction were adopted from the Instructional System Development 
(ISD) process''(Reference 7). - \ 



\ 



The tasks and ^behaviors required fq^ equipment maintenance ^ 
were idei;itified as the basic inputs Xo the model. A maiatenajige jA, 
analysis was performed and a Task Dictionary was developed to \ 
organize and define the tasks, "subtasks, and task elements necessabjL— 
for an avionics maintenance technician to perform his job. The tasks 
were then analyzed to find 9ommon tgisk- related characteristics*' which 
might impact the conduct. of a-training program. Five tSsk-related 
characteristics (parameters) were chosen as those best suited'for 
evaluating the tasks to determine whether training >vas requjtred for 
their proper pelrformance. Procedures were developed tben for 
assigning values to them. These task definition^ and the criteria^ 
chosen for detc'rm^ning whether a task would generate a training ' 
rec^irement were the basis for model development and data bank 
design. Characteristics of the job of which a task is a part, e. g. , 
technicisln-f equipment-, or maintenance concept-related, were al^p 
. recorded in the Task Dictionary and .used as additional ground riues/ 
constraints when- assigning -^values to thfe task characteristic para- 
meters for each task within the "fask Dictionary. ^ 

' The final part of the training analysis process wa,s the 
development of a training modeji design. It waa. implemented in such 
a^way th-at jsufficlient flexibility exists to permit model operation under 
a wide variety of' data a^^ailabi^ity circamstances. Thiis ensure* its 
applicability in the early sstagfes of the systems .acquisition process 
when.HttlfcLhard**dat£i is available; and beyond, when, more exact data * • 
is\3y^lable, to yield a^ide.-ranging capability to aid in resolving 
probieift situations within' the normal routine of traiaing planning. 

/ 'For thiis initial phase of system development, certain 
asjsumptions were made to simplify th^^operatlon of the training model 
with.painimal loss of^uthenticityr/'Vurthermore, Its general applica- 
bility fo a varieiy ^f syistena^ anid problems y^s ensured by (l)^*de- 
signing the data bank so tifiiJt its content and structure are user- 
defined (optional) and (2) designing the training model with sufficient 
flexibility so that, selecting and^sequencing o^ the* internal analyses 
are user-defii;^ed (optional). In this way^ T^AMOD was*developed 
to accept various options reflecting changes ia system, policy, and 
reso^irc^ factors, so as to relate these wit1i the resultant traihirjg ' 
impacts.' \ ; , ^ ^ • ' " 
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RESULTS AND COriCLUSIONS , 

Th^ tr'eining model, TRAmOD, developed to meet the 
objectives of the DAIS LCC Study, consists of four main compo- 
nents: < . 

- (1) Training black generator 
{2\ Training plan generator 

(3) Training prograirf^generator ' ; 

(4) Training analyst ^ . 

\ 1 , ' ^ 

"The first component (training block generator) selects tho^e tasks 
which require training. The second component (training plan 
generator) produces a training plan consisting of a list of the tasks 
to be trained, the type of trgiining for each (i. e. , school*or on-the- 
job), and training methods and media i^ecommendations. The t^ird^ 
component (training program generator), using the training plan, 
constructs a training schedule which takes into consideration the 
class and me^ia.' requirements cited as requirements in t^e training 
plan.^ It also allows for the careful scheduling of scarce training ^ 
resources. The training arlalyst, or '^jnan in the loop,'' is included 
as a component of. the model since , he* provides the judgemental 

. feedback necessary for the process to be self-correcting and self- 
adjusting. ' ' ■ ' I 

TRAMOD can facilitate the raf^d estimation of training re- «n 
quirenrients and the consequences of ^alternative approaches to ftlV* 
filling them, thus providing a means to aid weapon system 'designers 
and planners to morq fully consider the training implications of 
design. It can also serve as 'a first step in establishing a standardizec^,^— - 
approach to. training requirements analysis. Equally important is tbat 
TRAMOD can-allow the training analyst to better understand and 
evaluate the impacts of new systems on training requirements and the 
options available to fulfill them, ^in terms of the effects of the design ^ 
and maintenance characteristics of equipmient. This information can 
be used to influence the design^rocess% itselfl Iterative use of the 
model, with systematic nianipulatron of constraint par|imete*rs, can 
refine results and enable the user to examinie various sensitivities. 
In this way, TRAMOD can be applied to problefn^s such las the early 
identification of excessive requirements, inveistigation of alternative 
policy decisions, and training cost estimation. This capability, along 
with its capability to be operated using data available early in systeiyi 
development, should go a long way toward avoiding unnecessary 
training expenditures, by alldwing a user to abroach the solution of 
training problems in tferms of their causes as well as their substance. 
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DIGITAL AVIONICS INFORMATION SYSTEM (DAIS): ^, 
TRAINING REQUIREMENTS ANALYSIS MODEL (TRAMOD) 

' ' ' • ■ " ^' ' ' — ' ; 

- 1. Introduction 

The training model (TRAMOD) described in this report was 
developed to: (1) meet a need for a means to assess the impaqt of 
the . Digital Avionic3 Information Systenf (DAIS) concept of avionics 
integration on training requirements ; and (2) serve as a general tgol 
for examining the consequences of cirqum^stances which bear on the 
establishment of training requirements. Using a tec)in|^e for 
classifying learning requtrements and requisite training options as 
a {unction of the tasks to be performed, the model relates design 
aihd training in a way which Allows trade'roffs between cost^and 
operational constraints. It provides 1 odpability to rapidly gissess' 
training requirements and to select sUtEaijiing program most 
appropriate within the limits establishe^J .by a set of user-specifiabLe* 
constraining conditions, such as trainingjjost and training time. 

Although primarily designed for independent operation, 
TRAMOD is a part of the Life Cycle Cost Impact Modeling system 
(LCCIM) being cons tructedVithin the DAIS Life Cycle Cost (L.CC) 
study to assess the potential LCC impact of the DAIS. The LCCIM 
will also provide improved means for incorporating LCC and system 
support personnel consideration^ into .design, operation, and support 
decisions inade 'throughout the erystems acquisition process, 
particularly in its ^rly stages./^ ' , « • 

Although the, training data bank currently provided with 
TRAMOD is specific to avioni.Q^, the model itself represents an 
extremely broad approach to draining analysis. Its primary con- . 
tribution to training technologyas its generalizability^ and the in- ^ 
creased degree of logic and mechanization it brings to an area which 
is often thought to be more of an art than a science. TRAMOD pro- • 
vides a framework for*^a training evaluation process which, can be 
built upon and expanded to more adequately address specific needs'. 
I/i particular, the model can be applied to the early identification of 
training demands, the timely investigation of alte^natives, arid the- 
estimation of training cost. It can also provide an increased ' \ 
discipline in the development of training program^s. ^ ' , ^ 



2. GENERAL DISCUSSION 

V The basic objectives in developing TRA^OD were (1) to 

provide outputs to aid in estimating the training costs for the man- 
power requirements of the DAIS architecture, and (2^) to provide the 
capaljillty pf evaluating alternative training' approaches and training 
programs for DAIS maintenance*. These two objectives are related 
in that cost can be used as a criterion to evSiluate candidate pro- 
vgrams.v , I ^ 

^B^CKGROUNR | 

Trainifig^costs are an integral part of the human resourqe 
componentTTTw^eapon system LCC. More often than not, these costs 
are systeirl specific and must l^e estimated in terms of actual equip- 
ment maint^enance requirements, i.^., tasks. Thfe identification of 
the maintenance requirements of a neivly emerging'w-^apon system^ . 
particularly one in its conceptual stage such as the DAIS, requires: 
(1) the analysis of the reliability and maintainability (R&M) pbarac- 
teristics of similar equipment, and (2) the extrapolation of these 
results to the new equipment. These adapted values help form the 
elements of the emerging system's support reqiiirements, which in 
turn form the data base necessary for a training requirements ; 
analysis. 

Such a training requirements analysis was conducted on a * ^ 
conceptual design configuration representative of a possible DAIS 
application. It was preceded by a maintenance analysis depicted in 
Figure 2-1 and reported in References 2, 3, and 4. Results included 
values for the type, number, and skill level of the technicians needed 
to perform the principal maintenance tasks assdciated with each sub- 
system and line replaceable unit (LRU) of the- representative DAIS 
configuration. Support equipmtent (SE) requirements were also 
established. In this way, all maintenance data requirements for the . 
subsequent training analysis were met. What remairied was to trans-? 
form them into precise criteria for the selection of training pro- 
cedures and the establishment of training programs^ 

A literature search was conducted to identify existing 
techniques and/or models which could relate taskk to be perforrned 
to the particialars of training program establishment. A methodology 
and associated model were desired \yhich could assist a training 
analyst in conducting the trade-off studies required to develop the 
most cos^ffective trailing program. Although considerable research 
has beei|(^ conducted in this area (see bibliography), indicating a jieed 
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for a rfietht>dology with, this capability, no computerized analytical 
model Could be found tftatjatars capable of sati-sfying the needs at 
hand. The lack of a historical precedent necessitated the design of 
an'analytic approack^to develop the desired training model and datsfcr 
bank. Basic guidelines 'were adopted frorif the Instructional System 
Development (ISD) process, defined in Air.Force Manual 50-2 
(Reference 7); which is t^ie process gei^er^iUy a^soci^ted with the 
generation and^plication of actual trai^ning programs within the 
Air Force. TRAMOD. represents ^n adaption of that process for use 
"^"(1) in assessing training requireriients during the conceptual phase 
of a weapon sj;stem acquisition program ^nd (2) as a research tool 
an advanced development 'Studies. Th.e five nhases that constitute the 
ISD process are.;shown^n Tabl^-1, alonefwith the corresponding 
' elements of -th,e .training model. 

^ ' / ■ 

/ Table 2-1 

JSD /Training Model Co^parison'^ 

? ; : ISD Phases Training Model Elfements 

. 1. Analysis Task Analysis 

■ V Data Bank, Preparation 

2. Design Selectidn of Task Blocks 

■ Alternative Criteria 
' : Schopl/OJ'f Mix 

3-. Development Training Plan 

, '\ Methods and Media" 

4. Implementation Training Program 

Schedule 

5. Evaluation Feedback 



TRAINING ANALYSIS 



An overview, of the approach u^ed to develop TRAMOD and its 
associated data bank is given in Figure 2-2. The principal steps are 
numbered jn the block diagram and will be referred to in the general 
description that follows. 

The,basic data input requirements for the model are the 
specific tasks and associated behaviors necessary to accomplish 
equipment maintenance. This statement follows from the a^isumpr- 
tion that attainment of the skills and knowledges necessary to 

10 ^ . . 
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Figure 2-2 Development of training model and data bank 
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accomplish the designated task events is the principal objective of 
any training progrSin. 'Therifefore, ^^e maintenance >equiremenVs 
were evaluated (Blq^^-1) in terms of,4nose job char3CterisflGS wh^^h 
might impact that objective and thus influence the training |)ro^fa^. 

This evaluation consisted of identilFying Ijhe^mbst significant . 
jo6 characteristics^ and then categorfkinj^them IntQ the four gro^mps ' 
shown in Ta'ble 2-2. These dfe'scriptors wer^ 'ch^sen^ft'^r reeeaTrch- 
iog such sources as Air Force OcjciipationjrSurvey Reports// J,ob 
Irvventories, .Specialty traifu.ng^ Standards., Air Training Cc^hiand^ 
Course. Outlines, an(f the Instructional" ^yStem^-Develq^metit Majiikl., 
Subsequentno. thisv the^fl^e task -related charaqterisfics wer^ 1 
identified as h^Vin^ the 'greatest impact on the designing- of a twining 
program and were -Seleclied (Block Sa^as the parameters; to "be^Jecl 
' by^ the model 'for evaluating task^; Algpri^thm^ a^iit proeedu^es w^i^e 
then developed (Block 2) that cotfld syst^hiallcall^^bfe applied to^ 
assign values to tlijpse five task-related characteristics. AppLication^ 
of these procedures to assignj».values for the task-relateid character- 
istics rely upon the judgement of afialysts or techniciarte familiar 
with the equipmertt and tf^e associafted tasks necessar/ for its main- • 
tenance. Appendix B contains the ' definitions and criteria Selected * ' 
for evaluating. the five task-related characteristfcaZ^Th^ remaining 
three groups of technician-/ equipment-, and maintenance concept- 
related j9b characteristics were then used to establish ground rulfes / 
(Block 4) for the\task analysis. These ground rnles provide the 
"a priori" and th^ baseline information concerning the system under 
study and the environment in which thte tasks ire to'.be performed. \ 
They also provide a common reference frame for all subsequent 
analyses of tasks. ^ ^ ' / 

• . ' - / • 

Other considerations used in the d^^relopment of the training 

model design included its input and putpurrequirements. Inputs to 

-,TRAMOD are quantifialble elements suGf/as: student entry' rate/ time 

to train per subject matter or task, andT the average cost per student. 

The required outputs of the training model, subject to the provision 

of additional inputs concerning the characteristiics of specific tasks, 

were defined to include*: course length, required media, and type of 

training (on-the-ypb (OJT) training or technical training school (TT^). 

The oq- and o4f-equipment maintenance events were analyzed 
and used to develop a list of tasks (Block 5) which spanned the tasks, 
'subtasks, and behaviors necessary for an aVionics maintenance 
technician to perform his job. Any commonality of tasks among 
maintenance events was identiued'and usedi to group the tasks into ' 
duty ai:eas. This list became ^he composite avionics task dictionary 



'Table 2 --2 



" V 



'Job Characteristic-^ Impacting Training 




CritiC^lity to ^b. p.erformanae^ 

• "• - i ; * »•' 

- Difficulty to leapn - . 

Frfeqiiency of performance 

Skill' (p&ychombtor reguirement.) 

Knowledge (cognitive requirement) 



V 



Tec5hnician • 



/ 



Prj-or training/experience ♦ . 

Skill level ' ^ 

Training-to-applicatipn interval 



Equipment ^ . « ' ; 

Support equipment ( 

* Tools - ■ ■ ^ ^ 

'f ■ , ■ . 

Safety 

Newness 

9 

■ ' ' - • ' ■ ^ 

Maintenance Concept 

Technical orders/job guide material 
V ^ c, ^Crev( size 

Critipality to operational mission 



■i 
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which is included in Appendbc A. The previously' descpiJ^ed-eriteris^ 
and gtound rul^s for quantifying the )<ask chara^texjf^cs were thfen ^ 

^sed to eyaluat)& the elements b^the task dictionar^ (Block 6),. T;wo 
data banks were developed: (1)^ a baselin% historical trai|iing data . 

^bank which is based on a non-DAjS avionics syite and (2) a theoretical 
training- ^tajDank which is pjf-edicatlec} on a DAII? avionics architec- 
ture. The design and develofwrtent of the data banks >vill be dis(>ussed 

•in detail inJSection 3. " ^ ' , 



MODEL DESIGN^ . ^ . • / " 

V ' ^. ■ < ' 

w The Irainilti^ model xepres^ts^a metho deyelojDe^ to 

optimise, both )iTfe ^bpn?acll tQ trainingland the tt^ai^ng'pip^ram 
ftffelf ..-The. technix:^^^ us^d in designir^^ isVch a traifung^ 

iti6<fel jjiclude'd thie f^^ -\ ^ • . 

: r ' \- >.•• _ "-*>...^ •■ ■ • - ^' . \ • . ' A-' . ' « 7 * 

(i) . Identif icaCioh of main components in the development of a 

trainirig program ^ ^. ^ ^ x 

C2) ^ Compatilt)ility with associated data b^nk 

(3) Introduction of simplifying assumptions^ r\ / 

(4) __ Selection of available analytic tephniques 

Development of necessary algorithrps to perform analyses 
^6). Construction of model to provide^equired compatibility with 
♦ needs of training suialyst. . ^ # ^ 

These items a^^ discussed in general, terms in this subsection and 
described in greater detail in -Sections' 3 and 4. 

Figure 2-3 illustrates(^the four main components selected to 
ensure that the t/aining model cbncep^t followed the I!^'^ prdcedure: 
The training model analysis beginjs by using pre-established criteria 
to select those task blocks that require training. The second 
component in the niodel generates the training" plan, consisting of the 
following: task blocks to be- trained, type of training each will 
refceive (i..?., school or OJT), and recommended methods and 
media for training each task block. The third m"adel component uses 
the training plan to. construct the training program. This indicates 
the schedule used for training and the resulting resource'' require- 
ments. The fourth, and perhaps most ijnportant, component required 
for successful developnient of a training program is tlj^e training 
analyst. This "man in the loop" feature provides the feedback that 
enables the process to become self-correcting, -and the uaer is able 
to examine the intermediate outputs pf the training model and react 
to unanticipated variations or repeated irregularities in the pro- 
cedure. 
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In addition to"~^these four components, ^he training model also 
required appropriate Input data. It \vas recognized that the model 
desiga would be inflikencejf by. the ciirrent availabiUty of data-. All of 
the considerations in the techr^Lcal a^jproach tcMhe model were made 
in conjunction with the silnultaneous development of the data bank. 
The ufiodel was designed with enough flexibility and adaptability, ** 
howeyerrto allow its use w^fh-more docftplete' data in lffiiter phases of 
weapon system d§velopment. 

' The training model presented in this technical repbrt should V 
be thought' of as a, prototype, to be mddified and refine J in tfie future 
stages of develQpment. Certain assumptioi^ were marie iff developing 
the model design which simplif^.the^operation of i^e resuming mdSel 
with minimal Iqes Qf accuracy and authenticity. Tlfere is no con- ' 
eideration , of possible vai;?fatrons in the aptitude of the students who 
wm follow<-the training program being generatecf All student are 
assumed to reach the. desired proficiency le^e],,in the given. amount 
of ttme. It is further Assumed that school an^OJT give^iequally 
effective training results; there is no evaluation of the quaUty of a 
particular type of training or the competency of the trained person 
in performing a. task. 

Once the components of the model-, the available data, and the 
basic assumptions had been identified, appropriate techniques were 
needed to perforsn t^je reqvured analyses. The training mode assign- 
ment can be made accotding:^ to two different policy requirements. 
•When it is necessary for a^student to receive all the required 
training through one type of instruction, tjje resulting problem is 
best s^^ to a linear programming analysis (Reference 5). 
Bowj^^er, when the policy choice results in the problem of selecting 
the combination of TTS and OJT, instruct ion for each student that 
minimizes cost subject to a time constraint, the solution is best . 
obtained through a dynamic programming application (Referencjg,!), 
Methods and media are assigned according to relationships between 
tasks, training objectives, and training type. In this .component of 
the training model,- the most appropriate technique is a twO-step 
mapping: the first Ifrom task to training objective; the second from 
training objective to method and medium. 

,,Centain aspects of the training ^odel analysis necessitated 
the development of appropriate algorithms. For example, the 
selection of task blocks for training is accomplished with one of five 
possible decision algorithms, which screen the input task data in tests 
of varying degrees of restrictiveness. The training program 



generator presented a similar-situation. Sin§e the special nature 
and requirements of the training program s^rialysj^-jTe/g: , ^special 

.equipment of high cost ^ scarce resoui?i&^^. prohflbft^d th^ use 
of established scheduiing routines, a sp^jdtSf atgor to be 

developed for the Qonstruotidn of training schedulesl^^^ ; - 

\ ■ ■ ^ ^.r.; _ ' ' ' \ ■ 

The final consideration in designing the training model was - 
that it be compatible with the needs of the training analyst. «^Towards 
this goal, many options were added to the rflodel design to accocn- ^ 
•modate different system and policy requiremenfts, as well as - 
resource and operational^ constraints. The mappings used to assign 
methods'^and media can be altered by the user to reflect his need? 
and preferences. The policy chdice in reference to the^training mode 
aasignrrlent is another example of th|s adaptability. The mean^s-of 
relating s,ystem7f^olicy /resourfee factors .to thfe resultant training 
impacts are also contained in the model/ thus^ allowing the training ^ 
analyst to obtain relative ^mpact estimates of great v.alue early in 
the weapon system development process;, 

MODEL OPERATION \ 
* ' ' ■ ' ■ . 

Figure 2-4 gives an overview of the training model which 
resulted from the technical approach described in .the previous, 
sections.. Operation of the model is predicated upon the establish- 
ment of a data* bank containing the list of tasks to be performoJd. 
Their level of specificity is a user-defined variable allowing for 
flexibility of task definition. Each task should be assigned a scalar 
value for^ each of five task characteristics denoting: frequency, 
criticality, * learning. difficulty, and psychomotor and cognitive levels. 
Scalar ranges and quant if icat^jiori criteria are ptovided in Appendix B. 

* . *f . 

The data' bank is input to the training block generator which 
screens the total set of tasks in a series of go/no-go decisions to 
determii\e those tasks which require training^. The selected set of* 
^task blocks becomes the input data set for the training plan 
generator. The user maintains control of the screening process by 
his choice of selection criteria, i.e., screening algorithm and task 
Characterise thresholds. 

^At this point, it is assumed that all output tasks are to be 
trained. The user now designates values for three constraining 
conditions: personnel required (number), maximuiri\;^raihing cost 
(dollars), and maximum training time (months). The training plaa, 
g^ierator then perforpns an analysis to determine the training mod^ 
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/Assignment for the outputted task blocks, based upon . policy considera- 
tions assigned by the training analyst.- (For example, one policy 
option assumes each student receives all his training in either scho^ol 
or OJT. The alternate method assigns, each student to a mix of TTS 
andjOJT training.) The training plan generator th^ recommendi^ 
methods and^media for eafch task blocfk based*upon tasK classification 
and the assigned policy tor training mode selection. 

• • I* • * 

^ * After reviewing the initial training plan, the training analyst 

' may opt to re-execute the task selector and training plan generator 
using a different set of training criteria. ^This Rrocedm:je^a^ be 
iterated to generate alternative training plans until ^n acceptable 
one is'obtained.' This final training pKip, now becomes- the^gput data 
set for the training program generator. The user s'pecifies cU^s 
size restrictions', a task descriptor to govern the training sequence, 
^nd a (optional) high cost training medium whose use is to be « 
optimized. The final output of the model is a representative training 
prograxn consisting of the schedule, number of classes, and required 
items of selected media needed for the postulated trainee group. ^ 

(X)MPUT^rR^IMPLEMENTATlON 

^ TRAMOD has been programmed for operation on the CDC-=- 
6600 computer. A listing of the prograra is included in Volume II of . 
this report. TRAMOD was designed as an interactive program in 
, order to give the user the greatest amount of control oyer its 
execution. In addition to data bank inputs, its operation^ callus for . \ 
several interactive inputs. These. ^are listed in Table 2-3. TRAMOD 
prints a request for them, as they are needed, and reads input from 
the terminal in a free format. This ^prevents the possibility of an . 
aborted computer run due to bad data and appreciably lessens. the 
amount of preparatory work required of the user. It also helps the 
user to develop a more complete understanding of the effects of f 
individual data items on the training model results. . 

The interactive nature of TRAMOD also allows for increased 
flexibility in its operation by allowing for, a variety of options to 
meeTthe needs of different training policies and designs. Whenever 
the pro-am reaches a point where a decision is -required in order 
to continue execution, a.message is printed to the user. The program 
identifies the-possible options and waits for the user's inppt, as in 
* the screening algorithm choice required tp establish the user's tafik 
gelecfioii criteria. There are also occasions where the user is ' 
offered the, option of changing data default values, i. e. , specific data 
values incorporated as part of the program, such as the methpds and 
media mappings.' 19 . . ' . . ' \ 



Table 2-3- 
Interactive Inputs 



^ ■ ■ ■ ■ , . ' ' ' 

1. > Threshold cutoff levels for. the input characteristics't^ 

(a) Criticality / . 

* (b) Learning difficulty 
(c) Firequency ^ ' I . ' 

. ' (d) Psychomotor level ' * • . \- ^ 

(e) Cognitive level 

2. _ Task selection al go rittun choice^^ 

3. Number of trainee^o^e trained in each AFSC* 

4. ^ Regression coefficients for derivation of cost and time data 

for each task bl6^^ . . * 

5. 'Training time constrsdnt-:^ . * ' ^ . 

6. Training cost constraint"^ ' - 

7. TTS|0JT split;^ 

3. Alterrtative training objective mapping / • 

9. - Alteri^ative methocis and medigt^r training^ 

10. ^ Scarc^ TTS resource to be, optimally scpheduled^' 

11. Minimum class size-^' 

12. Maximum class size* 



* required ul^ut . 
^default values available 
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All the results generated by the draining model are output 
interactively as they are obtained, unlesV^uppressed by the user. 
This feature assists the user in directing theprogram flow, since , 
he can examine and^se the effects of previous decisions to help 
him make his next selection. Interactive output also aids the us^r in 
quickly identifying inappropriate choices made during runs in which 
the resulting training program is not satisfactory. 

^ Each analytic component of the training model presents the 
user with several alternative options for performing the required 
analyses. By exercising the model using different decision criteria, 
the user not only refines his results but also deterjnines those 
combinations of algorithms and data inputs best suited for. {iarticular 
applications. In some instances the user may decide that additional 
options are needed to match the needs and constraints of a 
particular design specification. The modular nature of TRAMOD 
makes modifications possible and allows for adaptability and refine- 
ment to meet future needs. ' ^ 

Iterative use of TRAMOD lets the usen direct the progt^am to 
repeat' analyses, both within and among* the major components of the 
model. This control gives the user the added capability of identifying 
the sensitivities of the various options and parameter values. 
Through examining the relative effects of input data changes, the 
User can identify those elements of design and policy which could 
give rise to problems' in the planning of training. This feature makes 
the model an excellent research tool for the training analyst - ^ 
interested in identifying the potential training consequences of 
design options for a new weapon system. 



^ , 3. DATA BANK DEVELOPMENT 

One of the first coufsiderations in analyzing the training 
impact of a/new system is the creatiop of a data bank cbntaining 
information for use in translating the equipment and/or mainte- 
nance characteristics and reJjiuirements into the data necessary to 
generate training programs. Basically, this consists of a systems 
maintenance /operations requirements analysis^.!! terms of task 
objectives for the system* It. is assiimed that each exercise of the \ 
model is to be accomplished using tasks within a Single technical 
Specialty area. Therefore, the tasks are grouped primarily by 
career field desigSSTion and sub-grouped by subsystem for th,e 
purpose of data baa^ organization. A dictionary comprised of these 
task'objectiyes is subsequently developed in terms of the behaviors 
substmied by the identified tasks to achieve a more refined descrip- 
tion of the tasks in terms of their behavioral characteristics. The 
classification and grading of tasks on the basis of behavioral ^ 
variables are used in the training model as criteria for the decisions 
concerning the Choice of tasks to be trained and for training plain and 
training program definition. 

Tnree principal aspects relating to the, developm'ent of a data 
bank for inj^bt to TRAMOD have been identi|j||d as requiring in-depth^ 
explanation: t - > 

(1) Establishing the task dictionary 

(2) Establishing characteristic parameters for the tasks and 
assigning their values 

(3) Assigning training times and costs tp^each task 

<' .1- 

TIV^MOD was designed as a tool for analyzing the training 
requirements of any new weapon^ system. The t^o data banks referred 
to in this sectio.n, however/ have been developed specifically for use 
in the DAIS LCC application. The above aspects of data bank develop- 
ment are, therefore, discussed in two reference frames in' the 
following subsections. They are 'first preseritied with appliqation to 
the historical or baseline data base, and then with consideration of 
the effect of DAIS implementation upon the baseline data due to 
changes in avionics, support equipment, and maintenance concepts. 

TASK DICTIONARY 

The initial ^tep in 'the development of the data base task 
dictionary was to perform an analysis of the maintenance /operations 
requirements for the avionics suite conceptual design developed > 
within the DAIS LCC study (Reference 10). The requirements. were 
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examined in terms Of the>task performance required of a mainte- 
^ nance technician at the completion of his specialty training program. 
This analysis , was tiecessary to establish a link between the equip- 
ment and a task oriented training program necessary to teach the 
skills and knowledge require^ to maintain that equipment. A hier- 
archy 'of tasks was^ established so that training requirements could 
be identified for each maintenance event agsociatedi with specific 
avionics equipment. This analysis was accompUShed'with the aid of 
the previously developed (Reference 3) DAIS reliability and main- . 
tainability (R&:M) model classification of maintenance events which 
include: "set-up supi>orf equipment," "troubleshoot," "remove and 
replace, " "on-equipmeni maintenance, " "verify the subsystem 
repair, ".and "bench check and repair.!' Related tasks within each 
event were identified for" a generic avionics suite by listing the 
'various maintenance actions that woiald occur during each ev^nt. 
Several iterations of this last process were exercised tp ensure 
that the avionics equipment mairitenatice tasks identified were 
comprehensive, tViough nbt necessarily exhaustive. 

This in-depth analysis, revealed the existence of redundant 
tasks across maintenance events. In addition, the combined tasks 
could not, , in themselves, be- construed as a complete training pro- ^ 
gram for a maintenance technician since there were additignal back- 
ground knowlefdge recjuirements necessary to guarantee successful 
performiance. "Tq correct the first problem noted, the R&M main- 
tenance events were grouped into four independent duty areas: 
flight line duties, shop dutifes, flight line support equipment fluties, 
and avionics "suppcWt equipment repair duties* Redundant tasks 
within a duty area were then combined le|^ing a single list of tasks 
for each of the four duties. For the ^'ecoft problem, current Air 
Force avionics maintenance personnel training course^curricula 
were consulted. This resulted in the addition o^ two new duty areas: 
General Technical and General Non-Technical. A list of job related- 
tasks derived from the training courses was appended to the 
appropriate duty area. * % 

Finally, the tasks within the six duty areas wer? reviewed 
again for omissions or redundancies, and the resultant list became 
the task dictionary as presented in Appendix A. It should be noted 
that some of the listed task designates are amended by either sub- ' 
tasks or modifiers. The purpose of the modifiers (unnumbered task 
elements) is to aid the training analyst in evaluating the scope of the 
task. Where subtasks are listed (identified in the least significant 
digit'of the task identifier)^the analyst may use these subtasks both 
to identify the scope of the T^k and also to exercise a greater level 
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of detail in the model if desired. If this capability is used, the 
training model treats the task identifier as a nesting parameter 
indicating associated subtasks. This parameter serves to designate 
tasks which logically fall together, either on the basis of their 
performance interaction or requirements generated by tfxe actual 
provision of. training. " . ' 

CHARACTERISTIC PARAMETERS 

Having completed the task dictionary,: the next step in con- 
structing a IJistorical data base required that a set of parameters be 
identified to Serve as a means for evaluating individual tasks. Those 
selected had to be common io all tasks in the dictionary and measur- 
able with some degree of reliability or repeatability. This ensures 
that different personnel involved in training analyses may arrive at 
similar evaluations of the same task.* ' , 

A review of the task dictionary was conducted to identify 
common parameters which would most impact a training program. 
Candidates were extracted from the ISD manual or suggested by 
engineering personnel experienced in electronics^jpiairitenance. A 
list was then compiled under several headings such as task-related, 
technician-related, equipment-related, or maiatenafice condept- 
related. The task-related category of parameters was chosen as 
that best Sijiited for evaluating tasks in terms of training require- 
ments, and was thus ^elected for use in the data bank. ; The five task 
characteristic parameters identified are (l)j criticality to job per- 
formance, (2) difficulty in learning, (3) frequency of performance, 
(4) cognitive activity, and (5) psychomotor activity. The first three 
are self-explanatory in concept and are defined in. Appendix B. The 
last two are used in lieu of "knowledge" and "skills. " No suitable 
specific taxonomy exists for defining or tneasuring the skill and 
knowledge levels required for performing maintenance tasks. 
Therefore, the means of defining the last two taSk characteristic 
parameters were derived from a behavioral taxonomy developed by 
Bloom (Reference 1). Appendix B, Task Characteristic Parameters/ 
Values, defines the above five parameters with respect to their use 

in the data bank. ^ • 

.. ■ . ■ ' ' ' , ■ ' 

^ ' Five distinct levels were assigned to each of the parameters, 
yith th^ exception of criticality which was assigned three levels. 
This number of levels appear^to be consistent with the accuracy of 
data available during the conceptual phase ot the design process and 
also with the sensitivity requirements of the model. Ap^pendix B 
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'defihes ihe relative values assigned to each parameter and also pro- 
vides examples of skills which might be required for sudc^ssful per- 
formance of a task. Appendix B was used bythe engineers perform- 
ingj^^e^ask evaJM|tion of the Ijiistorical non-DAlS and the DAIS ' 
equipment confi^rations. For the historical data bank, each engineer 
evaluated all tasks in the dictionary while considering a generic 
avionics subsystem. The results of these evaluations demonstrated 
a high degree of uniformity. Where a difference of two or more levels 
existed for any parameter, the evaluations were discussed before a 
consensus value wa,s assigned. Concurrent analysis indicated that the 
major reason for the differences resulted from variations in inter- 
pretation or concept of the tasks op, the part of the evaluator, rather 
than his misconstruction of the level definitions. 

Following yie task evaluation of a generic avionics subsystem, 
it was noted that the Value assignments of some of the task 
characteristic pax;^meters for certain tasks, such as "isolate 
malfunction," werie.driven by properties of the equipment. These 
tasks were identified, and engineers familiar with the subsystems ^ 
modified the level assignments for the parameters accordingly. 
For the remaining tasks, which are independent of equipment 
properties, the previously determined parameter values were used 
for all subsystems. 

t • " * ■ •. ■ 

TIMES AUD eOSTS_ 

The final step in developing the historical data base for ^ 
TRAMOD was the assignment of task training times and cofita for 
each^ subsystem. Attempts were made to insurp that both times and 
costs were as realistic as possible through the use of existing data 
and extensive enginieering analysis. Data needed for establishing 
training times was taken from sources such as the DAIS historical 
^ R&M data (Reference 3), Air Training Command (ATCj information, 
and course curricula for the Air Force Specialty Codes (AFSCs) of 
interest (References 11 and 12). Traininig cost data were extracted 
from Air Force sources and Rand studies (References 13 and 14). 
Both times and costs were isolated by training type: OJT oV TTS. ' 

One of ttie features of the training model is that the user 
' may substitute up to four sets of regression coefficients (one set 
eachifor T^S time, TTS cost, OJT time, and OJT cost data) in Ueu 
of the ini^idu^ task segment training time and cost data contained 
in a da^Iabase. This.feature is included because it is anticipated 
that ihe training mc^del will be used in applications for which task 
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segment times and/or costs^mayjiot be known. If so, the user may 
judge that the application under S^tu^dy has strong similarity to some 
prior use for which the needed values were availaoie. In that case, 
a regression or isimilar analjrsis oi\ this prior data 'could provide 
viable input coefficients to determine the needed data. The ^ 
coefficients are used in conjunction with the task characteristic 
parameter values to determijne the time and/or cost data either 
across-the-bo^rd to reflect a general change, or for those specific 
tasks for which no time or cost data is available. HoweVer, when an 
analyst wishes to change time or cost.data for a selected subset of 
tasked within the larger set of tasks assigned to a. given AFSC, this 
must be accomplished through modification oX the data bank itself 
rather than through use of regression coefficients. EaCh Bet of 
coefficients comprises one constant value and five multipliers, one 
for each of the task characteristic parameter values. These 
coefficients are^entered manually by the analyst as an interactive 
step. ^ * 

For the case where neither current nor user-generated 
coefficients are available, sets of defa:ult coefficients that are 
incorporated within program TRAMOD may be used on demand. 
The default coefficients supplied were determined through linear 
regression analysiis on a datat)ank prepared for tasks peculiar to 
the DAIS training application. It is important that, the analyst 
re£^ize that these default, coefficients should be used only when no 
reliable data exist and, ^ven then, the output products should be' 
screened with care. ^ ^ 

DAIS CONCEPT " * > - 

Once the methodol^y and terntinology were established for 
developing the historical training model data bank, construction of 
the DAIS theoretical data bank depen^ded primarily upon defining the 
training requirements in terms of the DAIS concept. The develop- 
ment of the DAIS theoretical training model data bank was a 
logical extehsion of the maintenance analysis that preceded the 
development of the mid-1980s DAIS R&M model theoretical data 
bank (Reference 2). The determination of the effects of DAIS upon 
' equipment R&M characteristics was'^foUowed by an analysis to 
determine the corresponding effects upon maintenance personnel 
training requirement's. The major considerations were (1) equipment 
design, i.e., th# hardware and its associated Software, and (2) the 
general maintenance policies" affected by DAIS, such as manpower 
allocation. The following pa^graphs initially deal with the above two 
.aspects, and, then proceed to describe the necessary changes to the 
historical; training model data bank as a 'result of DAIS. 



V FWusing attention first on DAIS hardware /software-related ' 
aspects, the major effects of DAIS were studied after first ' 
establishing conditions or guidelines; the principal ones include: 

1) All sensors remain as is, ue., there is no change 

of equipment configuration, with the exception that ■" . 

certain control, display, and interface \anits are ■ 
relocated in the core. The core elements, of the DAIS 
architectures consist of .the multiplex bus and interface 

. units, processors, integrated control^ and displays, 

and special software. Whereas most primary functions 
• are centralized under the DAIS concept of avionics 
utilization, certain computational devices such as the 
navigation, mission, and bombing cbmpjuters or 
processors were reconfigured as a core function. The 
•appropriate R&M model characteristics were adjusted 

'■ for this transfer of functions (References 2, 3, and 4). . 
Specifically, these adjustments consisted df transferring 

the task requirements (e. g. , time to accomplish, 
n\imber of technicians, their Air Force Specialty Code, 
. . and Support 5:quipment) to the new core subsystem 

maintenance networks. Appropriate reliability 
values were also assigned for these new s^bsystems. 

2) In accocdance -with the DAIS system architectural 
guidelines,, the controls, displays, and processors are 

' integrated as much as is feasible. Additional software 

' is assumed to exist to aid in integration and to reduce;^-^ 

the common hardware items in the core. . 

3) As a result of the abo've two considerations, minor A/D 
(analog to digital) and D/A redesigns have been postula- 
ted to peryiit sensor /core interface. This interface is a 

■ function of the remote terminal units (RTUs) in any 

DAIS configuration, and does not affect the sensors 

(Reference 2). . 

4) DAIS design lends itself to the inclusion of a Central 
integrated Test System-(CITS) for isolating mal- ^ 
fianctionging LRUs on the flight line. The caps^bility of 

a CITS to provide an improved built-in test (BIT} 
capability, thus reducing the cannot' duplicate mal- 
function (CND) rates both on the flight line and in the 
shop, must -be considered. (The R&M model data, which 

was obtained from the DAIS maintenance analysis 
^References 2 and 3), reflected these CITS impacts. ) 

* • * . " ' 
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5) Although DAIS avionics support equipment is different 
' frQm non-DAIS, its major inSpact on training require- 

' . ments derives from the number of tests it will perform ' 

^ and the accuracy of these tests rather than its speed of 
accomplishment (References, 2 and 9"). . 

The above, conditions and effects have subtle impacts on the 
cjata bank, both directly and indirectly. THe indirect impact is 
reflected in the general maintenarfce policy considerations, defined ' 
below/ which were identified as ^appropriate to a DAIS avipnics 
configuration. «• ^ 

1) Consideration ia given to the possibility that mainte- 
nance technicians may be assigned solely to the flight 
line o-r shop e.g. , consider the policy of training only 
one to tiiree AFSCs to perform all flight line tasks arid 
•similarly training- six different AFSCs to perform the 
shop tasks (bne for each of the six test stations). This 
solution is dependent tg some degree upon the BIT /CITS 
capalDilities at the flight line and the test station 
capabilities in the shop. However, it may reduce the 
teaching of extraneous inform'jation and thereby reduce . 
overall training times. - 

2) ' Training for DAIS personnel will probably b% limited to 
' ''need to know;;' subjects. For example, assume that the 

test stations are capable of isolating malfunctions at the 
/functional or mDdujlar level. If the LRUs for a sub- 
system are repaired maihly by removing and replacing 
the shop replaceable units (SRU), th^n it is quite likely 
that the technician need not receive the in-dejjth train- 
> ing in "knowledge of electronic principles, '' which con- 
stitutes a major portion of the current course curricula. 

3) The mean time to repair (MTTR), times per task at the 
LRU level, remltn the same for both DAIS and non-DAlS 
airmen. Howe^^ver, maintenance man hour (MMH) times 
change as a function of the number of personnel assigned 
per task and there will prot)ably be differences between 
the non-DAlS and DAIS configurations. This was deter- . 
mined in the R&M model maintenance analysis 
(References ^ and 4). 
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CONSTRUCTION . . ' 

y ' (fonstruction of the DAIS data banks consisted primaray^of 
deTining the previously ^^eviewed DAIS impacts in terms of the data 
bink variables: the tasks; their characteristic parameter values; 
and associated training times, and costs. ' ' 

TaSk assignments: The tasks listed in the historical data bank 
dictionary, with the exception of a few additional subtasks and 
modifiers added to account for tHi2 increased software, were . 
comprehensive enough to cover DAIS, avionics. ^ 

Task characteristic parameter level assignments: The 
following was concluded from a task' oriented training analysis which 
took irito account the previously reviewed DAIS impacts: 

• No need to change any, of the criticality assignments 
' between the two data banks. ^ 

No need to change any of the psychomotor assignments • 
between the twp data banks. 

• Frequency values formerly scaled-relative to historical 
subsystems' maintenance index data should now be 
scaled relative to the niaintenance index data for DAIS 

- subsystems. The algorithm for level determination 

need not be changed. v 

• Cognitive and difficulty levels should be modified 
slightly to account for DAIS vs. non-DAIS differences 
in the equipment-related tasks mentioned previously. 

rv^ Training time and cost assignments: No change is needed in 

^ither the TT.S or OJT hourly^costs between the two data banks 
because the dominant cost factors (wages, benefits, and facilities) 
, are not impacted. OJT'^times by task change only a& a function of the 
DAIS architecture partitioning. TTS times^by task change mostly as 
a function of the .architecture partitionlng. 'However, a few of the 
general duty task times such as ''knowledge .of electronic principles'' 
are reduced. 

A comparison of the DAIS data bank with the historical data 
bank, by duty area, reveals little ^Jifference between the two. This 
results frotn usirig similar equipment irt the two avionics suites. 
The major differences occur only where the equipment has changed 
sufficiently to generate new support personnel requirements. The 
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required tasks and their assigned characteristic parameter values, 
times, and costs for the flight line support equipment and the avionics 
support equipment repair duty areas are identical between the data 
banks. Only time allocations are slightly changed because the flight ' 
line and shop duty area tasks remain the same for both the pon-DAIS 
and DAIS Configurations. The equipment related tasks do, however, 
reflect changes in the (difficulty and cognitive level evaluations as a ^ 
result of I3AIS; as do some of the OJT times. The^General Technical 
and General Non-Technical d}uty area tasks ^naintain the same task 
characteristic parameter values and costs, but their associated TTS 
•and OJT times are slightly changed. Finally, the ^'knowledge of 
^ specific subsystems** or '^knowledge of specific test stations*' tasks 
required modification to reflect the differences between the DAIS and 
hon-DAlS av^nics. 





' . 4. TRAINING MODEL DESCRIPTION 

This section provides a detailed explanation of the techniques 
used in TRAMOD and its operational capabilities. The discussion is 
segmented in terms of the model's four primary functions: task 
seLectibn, trairiing mode assignment, rftethpds and m^dia assignment, 
and training program schieduling. ^ 

TASK SELECT16N ^ 

The first component of TRAMOD functions, under user defined 
constraining conditions, to select the tasks which require training 
from those in the initial input task list. Output is in the fiSrm of task 
sets or "blocks" of tasks to be trained as a xmit. This function is 
performed on the basis of a set of decision algorithms which screen 
the input data against test criteria established by the user. Thpse 
criteria.«re limiting values lor eacli of the task characteristic 
parameters described in Secftion 3 which establish cutoff levels for 
each screening decision. Five algorithfns allpw these thrw^holds (NO 
to be compared With the actual task characteristic parameter values 
(Cj) in tests which vary in their dfegree"of restrictiveriess. 

The selection of an algorithm for model operation is dependent 
upon the user's interpretation of the relationship between the tasks 
and their individual task chfiiracteristics. The most restrictive of the 
screening tests, the "AlV decision tree algorithm, considers all 
parameters to be equally important and requires each to meet a 
specified level for training to be warranted. However, this algorithm 
can be used to test on the basis of single or groups of parameters 
within the total set. This would be appropriate when the user 
perceives unusual differences in ta^k characteristic parameter ^ ■ ■ 
relevancy or wishes to explore outcome possibilities based on their 
postulated existence. Selective parameter exclusion from the train/ 
no-train decision process is achieved by entering a "O" cutoff level 
for those to be excluded. This causes them to be ignored by the ''All'' 
decision tree algorithm, resulting in a training requirement decision 
based solely on the remaining parameters. 

The least restrictive test algorithm is the "Any" decision tree. 
This requires that only one of the task characteristic parameters meet 
a user-selected threshold value. In general, for a given set of N. 
values, this algorithm will yield th^ largest subset of test blocks \o 
be trained, permitting any one of the five parameters to dominate the 
establishment of a training requirement. This test is most appropriate 
wfien the user feelslhat a specific parameter should be the sole factor 

in the screening decision. Choosmg values of "6" for four of ttie five 
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possible cutoff levels will result in an affirmative task block 
training decision only if the value of ^the remaining task characteristic 
parameter meets its threshold. 

The remaining three algorithms test functions of the task 
characteristic parameter values rather than the individual values 
themselves. A given set of N. values used with one of these tests 
results in a group of tasks designated for training having morevvaried 
task parameter values than those designated by the two decision tree 
algorithms. Two of the tests compute the root- mean- square (RMS) 
value and the pure average of the parameter values and compare them 
to a selected threshold value. The last of the screening algorithm 
choices computes a weighted average of the parameter values on the 
assumption that. the user's choice of individual parameter value ^ 
cutoff levels indicates thd relative importance of the five parameters. 
Table 4-1 illustrates the results of applying the various decision 
algorithms to a set of tasks, using a fixed set of threshold values 
(N.) and task characteristic parameter values (C^). 

The RMS and pure 'average decision algorithms allow task 
characteristic parameters* with high values to compensate for others 
with low values. An RMS test passes tasks that may fail the pure 
average teipt, since the-^squarjng of the parameter values gives 
parameters with high values even more weight than they would be 
accorded in an averaging process. This property makes the RMS 
algorithm most approp^^iate for screening tasks whose *sets of ^ 
char^Lcteristic parameter values deviate signifiqantly from the itiean 
of those values. The most appropriate choice between these two< 
options is dependent upon the thresholds selected as "well as on the 
task characteristic parameter value profile desired. to characterize a 
task to be trained. Consider the following two sets of threshold 
values: 3, 2, 3, 3, 2 and 1. 5, 4. 1. 2. Both sets have the same 
mean value, but the second set has a much higher^ standard deviation. 
If this set of thresholds is used, then the RMS algorithm will generally 
s^jj^ect more tasks for training.^ 

'^'i ' The model uses the screening criteria to select i?idividual 
task^ requiring training, and then collates them into aj^spciated task 
blocks. It does this by examining the task-associated rifesting 
parsLmetjers described in Section 3. If oiie ^ask in a nested group is 
selected for training, then the entire group will be traixMBd a1s a task 
block. Therefore, the task characteristic parameter values assigned 
to each task block are the maximum values of those within the 
nested task group. These outputted task blockg^Wbome the input data 
set for the second component of the model which constructs an initial- 
training plan. '^0 
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TRAINING MODE ASSIGNMENT 



The first half of the training pl^ generator identifies the type . 
-►of training to be assigned to each task block. The training mode ^ 
diBcision, TTS or OJT, is determined by the tr^iining analyst's 
choice of policy, cost and time constraints, and number of personnel 
required. In order to perform this ahalysis, OJT ajid XTS training 
time and cost ret^uirements must be assigned to each task block. . 
/There are three •^methods available for obtaining these data: 

(1) Diri^ct input of training times and costs for each 

task block in the input data set 

• ^ ' ' ' J, 

(2) Calculation of training times and costs with user- 
selected regression coefficients; times and dos^s 
are linear coij^binations of the task. characteristics, e.g. , 



fot each task block i where: 



-bost (i,OJT) = K +.?,K4#C.. ^ 
o j-1 J ij 



K. is the regression coefficient JFor OJT training 
. ' * ^ th . ^ . . 

costs for the j characteristic, 5. 

^ ■ ■ th <* * " 

■ ' I * C . is;the value of the' j characteristics of liie . 

" ■ " '5 >it^^taskUock. ' ^ 

(3) Derivation of time,s and costs using the fixed default 

regression coefficients presently available in TRAMOD 
in consort with the above. equation. . 



1^ 



Selection of the first option indicates that the data have already ^ . 
been read in as part of the input data bsink. As task blocks are 
selected for' training, the appropriate time and cost data are' 
accumulated and stored with the reBt of the task block data.* Xhe 
second option requests the user-selected regrei^ion coefficients be 
ehtered interactively during execution of the model. The third option 
requires ho data input, as th^ default coefficients ar6 stored in TRAMOD 
axi^d are available upon demsind. During sessions with multiple runs, 
regression coefficients ^entered under the second option "become default 
coefficients for all successive runs. All three options result in 
the times and costs data arrays needed for the training modS 
selection process. The training model makes the TTS/OJT decision, 
in one of two ways depending on the policy requirements of the 
training prograni. 

34 



A ^'non-mix" option assumes each student is trained solely 
through school or OJT, but not both. The model calculates the 
student split between TTS and OJT baised on a ''quality" assessment 
of the training requirement. The concept of quality used in this 
section is a measure of deviation from the optimum candidate 
criteria for both TTS and OJT. as explained therein. . 

First, the model computes the time and cost values to train 
a student through school and OJT using the initial screening options 
available ib the training analyst. Then, these^ values Tg. T^. Cg. 
and Co» respectively, are tested against the user-defined constraints 

for training program time and cost T , C„ ). Next, the 

XI i a^ XXI a A 

model checks for the feasibility of each of the training modes within 

the time constraints^ A subsequent test compares C^__- with the costs 

XXI ax 

for those values meeting the time constraint. The model calculates 
the student split only when both TTS and OJT training modes are 
feasible. Let OC. and SC., i = 1, . . . , 5 represent those values of 
the five task chjaracteristics which are most appropriate for OJT and 
TTTS training. TDefine two "distance" functions, d and d^, applied 
to each task block selected for training, as follows: 

(J) =Jl [(C(j;i) -SC.)^] 

where C(j, i) denotes the vaW^ of the i*^ characteristic of the task 
block. Then dgCj) is a measure of the deviation of task block j from 
the optimum candidate for TTS training, and similarly, do(j) with 
OJT training. Both funqtions can be averaged over the selected task 
'blocks and the overall population deviation from the optimum ^training 
criteria can be defined as 

where Nq and are the number of sjjudents. in TTS and OJT. The 
"quality*^ of the resulting training requirements, as previously defined, 
is piaximized as J ii3 minimized. This problem can be solved by a 
linear programming application (Reference 5) and reduces to the 
equations: 



I 



Thes^ two equations then give the split of the trainees to be trained 

in TTS and OJT. ^ 

The alternate method of determining the training mode assumes 
eaqh student can be trained through a combined program of school and 
OJT. The model uses the time consfraiht for the training program 

"and assigns a training mode to each task block through a sequence of 
interrelated decisions. The analysis is performed through a dynamic 

' programming algorithm which provides a systematic procedure for 
determining the combination of decisions that minimizes the qv:erall 
cost. The basic features which characterize this as a dynamic pro- 
gramming problem ar'e discussed below. 

The model examines.the task blocks: and keeps track of the 
time and resources epcpended by each under the two training modes. 
Each task block is theiTassigned to QJT or TT^Ig irlj order to minimize 
fbMerall resource consumption for thq training program* In dynamic 
-programming terms, each task block represents a ''stage'' requiring 
a decision. The "state*' for each stage /task block is the amount of 
unconsumed time left for training the unassigned task blocks. For 
example, if the decisiton is made to train task block n at TTS when 
there are 30 weeks left for training, and task block n takes X6 weeks 
to train, then the decision for block n+1 is made with 14 wefeks 
remaining in the training progranfi. 

A recur siy^e relationship identifies the optimal policy for each 
state . at task blocW rl, given the optimal policy for each state at j[ask 
block n+l. The minimum cost for training task block n witti time 
remaining in the training program is 



f (s ) = miri* - j f . 

n n I 

t ^ s ' 
n n . 



(s^-t :> + c L) ) 

Inn n ^n I 



where 



,. c ■ 

s = time left to allocate to task block n 
n 

t^ = time required for either OJT or T,TS training. 



c (t K cotet ^fesociated with either OJT or TTS training. 

n n ' . 

Therefore, finding the optimum^'policy when stairting in states at 
Xask block n requires finding the minimizing value of t„. When there 
are N task, blocks to be trained, the optimum training plan is found 
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by iterating the above equation N times. Further discussion of the 
algorithln can be- found in Reference 5. 

♦ 

At this point in the execution of the model, each task block 
has an assignment of TTS or OJT training. If the combination TTS/ 
OJT instrAiction has been chosen by J;he model user, all students will 
foll^ow the same training plan. Otherwise the model will generate ^wo 
training plans; one appropriate to the OJT and the other appropriate 
to the TTS course of study. 

METHODS AND MEDIA ASSIGNMENT 

^ The second half of the training plan generator assigns an 
appropriate training method and medium to each selected task block. 
In order to do this effectively, it is necessary to correspond method- 
and media characteristics with hiiman performance requirements. 
This in turn requires; a meaningful classification of hur^an perfor- 
mance with respect to the significance of learning principles and the 
importance of specific task influences. The classification system 
used in the training model is defined in Parker and Doy/ns (Reference 
6) s^nd consists of the following six classes of training objectives. It 
is recognized, however, that this system is-only one of many >;^4iich 
might have been used^ ' 

. 1. Learning Identifications. This means pointing to or 

'locating objects and locations, naming them, or identifying 
what goes with what either physically or in words or 
symbols. This latter includes much of what is commonly 
denoted by the word "facts". 

2. Learning Perceptual Discriminations. This involves the use 
of visual, auditory, and similar cues in^ a manner which 
allows the identification of a particular stimulus. The 
integration of these cues, some 6f which may be just above 
the threshold of perception, occurs primarily in the course 
of direct practiced 

3. Und^standing Principles and Relationships. This usually 
means understanding a statement of relationship as shown 
by being able to state, illustrate, and recognize its 
implications. Often this is a statement which tells how a 
cause produces an effect, or how a result can be predicted 
from several component factors. It may involve knowing 
arbitrary rules of contingent procedures, e.^g. , "if such is. 
observed^ do thus and so". / 

4. Learning Procedural Sequence. This means knowing how 
to carry out a set of operations that must be carried out in 
a fixed sequence. 37 



5. Making Decisions (Choosing Courses of Action) . This 
usually involves the applicatiop of conceptual rtiles of 
principles as the basis for making the kinds of decisions that 
are involved in diagnosing or interpreting complex situations. 

6. Performing Skilled Perceptual-Motor J^cts. These may be 
quite simple, (using basic hand tools) or quite difficult 
(manipulating the controls of an airplane or performing a 
sensitive adjustment that requires precise timing). Often, 
like the learning of identifications, the performance of 
uncomplicated activity requiring only rudimentary skill 
provides for the accomplishment bf necessary steps in mbre 
complex tasks that require the following o^J^gthy pro^dui^es. 

The human performances data used in the training rjrfo del are ,' 
in the form of the five task characteristic parameters d^cribeciin- 
Section 3. The training plan ^generator incbrporates aonapping of 
each of the taxonomic levels which can be assigned to a task block 
with a particular training objective. It uses the Wtgher of th6 two 
cognitive and psychomotor values associated wi^ each task block to 
determine the*iost appropriate training objeqttve for that block. 
This mapping is illustrated in Table 4. 2. 
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The six training objectives are ©dch assigned a method and 
medium most appropriate for conveyiijg the learning princliples they 
represent, and also most appropriate for the mode of training 
assigned to each task block (Table/4-3). The following definitions, 
found in Reference 8. identify th/training methods which comprise 
the present 'TRAMOD selectior/repertoire. 



Informal Lecture: 



Demonstration: 



Performance: 



Discussion: 



a discourse given before an audience 
f0r instructional purposes 

^ an accurate portrayal of the precise 
actions necesisary to perform skills or 
processes 

a student practices, performs, and 
applies, under controlled conditions and 
^ close supervision,^^ the skills or 
knowledges which have been previously 
explained and demonstrateti 

an interaction between students and /or an 
instructor in order to analyze, explore, 
and/or debate an issue, topic, or problem 
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Table 4-2 
Mapping^for Task Classification 



Taxonomic Description Training Objective 


Psychomotor 4 (Imitation) 


1, Learning Identifications 

^ ■ ' ■■ 
■ \ \ 


Cognitive 1 (Comprehension) 


Psvchomotor >> (ManiDulation) 


2. Learning Percentual 
Discriminations 

r 


Psychomotor 3'»(Precision) 


Psychomotor 4 (Articulation) 


3. Understanding Principles and 
Relationships 


Cognitive 2 (Application) 


Cognitive 3 (Analysis) 


4. Learning Procedural Sequences 


Cognitive 4 (Synthesis) 


Cognitive 5 (Evaluation) 


5» Making DecisionSx ' 

— — — iu 


Psychomotor 5 (Naturalization) 


. 61 Performing Skilled Perceptual 
Motor Arts 
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Table 4-3 



Mapping for Methods and Media 



Training Objective — — r-5]!I>^Method/ Media 


1/ Learning Identifications 

" . , •■ .0 


TTS: Discussion/ Transparencies 

PJT: Informal Lecture/ 
Transparencies 


2. Learning Perceptual 
Discriminations 


TTS: * Simulation/ Training Film 
OJT: Demonstration/ Training 


Understandings Principles 
& Relationships 

* 


TTS: Simulation /Simulator 
OJT: Performance/ Mock-Ups 


4. Learning Procedural 
Sequences \ 


TTS: Performance /Simulator 
OJT: Performance/ Training Film 


5. Making Decisions 


TTS: Simulation /Simulator 

(5jT: Performance/ Training Film 


6, Performing Skilled 

Perceptual Motor Arts 


TTS: Performance /Simulator 
OJT: Performance /On-Equipment 



Simulation: a representation of ,pbme aspects of reality ; 

(either a process, ^ent, or hardware) by 
symbols or devices that can be manipulated 
* . mor6 readily than their actual counterparts. 

Informal lecture, demonstration, and performance are used fpr PJT 
courses as the craftsman-apprentice nature of this training lends 
itself to these methods of instruction. Tasks trained through the 
more traditional instruction offered by TTS are assigned methods of; 
either discussion, sirjjulation, or performance. 

The model assigns each task-block one of the following five 
specific media (Reference 6): 



Simulator: 



any deyi^ which presents most of the 
parameters of the work situation 



Training FilWi: 



Transparei^cies: 



a film produced as a means of imparting 
technical information generally to large 
groups of trainees 

pictures or drawings projected onto a 
viewing screen during a training lectiijrfc, j 



Mock-ups: 



On -Equipment: 



three dimensional equipment represpn-' 
tations which may or may not use actuaL^ 
equipment components 



the actual system for which tKeHrVining 



is being conducted. 




Each of the first four media is considered td%te 
tative of at larger class of media. The four cl3iSs6a^v%h/^/^f. 
and their memberi^are listed in Table 4-4. '^Some ajt the- facto r^^ 
be considered in media selection include the numben Of Studentjs ^^^^ 
involved in the program, the costs of hardware acquigitipn'^an^^^ oA 
operation,^ and the costs associated with producing arid m^^^lntaining ^ 
courseware. The model user^ay choose to select )^^^ 
medium within the appropriate class in accordance witli! flpeciflc;^ :^ 
training or design requirements and resource constrairitialVrpie 'eaii ■ 
also alter either of the mappings themselves through apptopgciaitisr 
option^ in the training model. 
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Table 4-4 
Classes of Media 



Environmental Media /Aids 



♦Sixinialator 



^ Games 
' - Role Play 



Procedures' Trainer 



Visual Aids: Still Images 

Opaque Projections 
♦Transparencies 
Slides 
Charts 



Visual Aids: Exhibits^ 
♦Mock-ups 
Cutaways ^. 
Mojiels ;^ ^^ 



Aninfiated PanBl.s,. . 



, ^niedium chosen ^^-^^0^^^ class 



Transient Media; Audiovisual 

Sound/Slide Projector 

Television 

Motion Picture 

; *Triaining Films 
(sound filmstrip) 
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TRAINING PROGRAM SCHEDULING 



"^After reviewing the initial traiMypg plan, the TRAMOD user 
may select a different set of policy/oecision ci^iteria and exercise 
the model again to obtain another training plan. The task selector 
and training plan generator will general^ be iterated several timea^ 
as an investigation/optimization procedure prior to the selection of 
a final training plan. Of course, if the user accepts the initial 
results of the model as satisfactory, execixtion continues on to the 
training program generator. This final component of the training 
model then generates a representative training program based on a 
set of internalized rules of resource management. The training 
program consists of schedule, number and size of classes per" 
program^ number of media items, and course lengths. The user . 
specifies ihe required number of trained personnel, minimum/max- 
imum class sizes and a task characteristic parameter, such as 
difficulty, to order the training sequence of the task blocks. 

TRAjllOptalso allows one of the assigned media to be 
identified a^^sitf iiigh cost driver which is to be opttxnized. The 
algorithm in this section then generates all possible arrangements 
of*the training schedule so as to minimize the required quaiititiefs 
of the specified medium. It combines the task blotks requ^ing/the 
high cost medi^^rn into a consolidated group and then iterativ^ly shifts 
the pla'cement of this group in the training sequence. In this way, 
a single unit of a training medium can be used to train more than 
one class of students, which greatly increases its effective use. . 
The relative training sequence among task blocka<not using this 
medium remains fixed in accordance wih the user's choice of nan 
ordering task characteristic parametery The result is a reason- 
able first cut at a training program witili^fficient detail to obtain 
training cost estimates when the requirements are given as input to 
the life cycle cost impact modeling system qf which the TRAMOD 
is a major component. 

As in the training plan generator component orf the TRAMOD, 
the results of the training program generator component may be 
iterated to determine various sensitivities. Doing so may reveal 
excesses in respurce consumption which might be avoided by changes 
upstream close to the equipment design end^of the training analysis 
procedure, ^he capability for iteration using different sets of 
criteria is clearly one of the strongest features of the TRAMOD. 

43 



5. CONCLUSIONS . ^ 

* A methodology has* been developed which addresses the quali- 
tative aspects of human resource requirements of new weapon sys- 
tems. An extensive repertoire of training technology exists which' 
supp)orts the design of training systems. The training model pre- 
sented, in this report facilitates the application of this information. 

Decisions concerning the establishment of training plans and ' 
pro^rarps are becoming more and more difficult due to the increas- 
ing number of variables which training, analysts must consider. 
This situation is made worse by the narrowness of the time frame 
in which the results of training analyses may provide useful feed- 
back to designers and planners. However, i|ie problem assumes 
increased importance as planners become more attentive to the life 
cycle cost aspect of systems acx^uis^ition. ^ ' * • 

Training is expensive, and its expense reaches far beyond 
the cost of producing trained personnel. The real cost of training 
includes penalties paid in terms of lost opportunities, These-are 
the costs associated with failure to capitalize on numerous poten- 
tials* for cost avoidance due to an inability to extend the analysis of 
training requirements beyond its present role of reacting to givfen 
sets of conditions. Clearly, it would be advantageous for a training 
analysis to becomie an integral p^rt of the weapon system design^ 
process rather than a post hoc activity. This requires the oagoing * 
participatiomof the training analyst in all phases of those design and 
policy decisions which create training requirements. The modeling 
approach to training impact analysis can make this change possible. 
It can incr^se the speed and systematization of the- procedures 
entailed in training planning and resoui^ce management. TRAMOD 
provides a means by which early analysis of training impacts may 
be standardized/ thus offering potential cost avoidance. 

Quite apart from its potential for aiding designers in the 
development of more maintainable find cost effective systems, its 
versatility makes the trainjlRg model ideal for even the most mundane 
. problems concerning the provision of training and resource manage- 
n ;nt. The training analyst who has an understanding of the effects 
o. the various training model parameters and options can generate 
a training program which reflects numerous policy, resource, and 
operational conditions. The sensitivities of changes in factors, such 
as use of job guides, aptitude and experience of the trainees, and 
availability of support equipment can be examined by appropriate 
changes in the interactive inputs. 
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The training model described is a first step in defining a 
methodology for the practicaj. a|jplication of the modeling approach. 
The model itself stands alone as aNmechanism capable of perform- 
ing many of the required data manipulations entailed^ in a train- 
ing impact analysis. What remainsjJs for the training community 
to continue its development in i^^fms of data and criteria* 
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1^ Appendix A 

T^ask Dictionary 



• General Technical Duties 

• .Flight Line Duties 

• Shop Duties 

• Avionics Support Equipment Repair Chities 

• Flight Line Support Equipment IXities 
m General Non-Technical Duties 



Appendix A 
TASK DICTIONARY 

GENERAL TECHNICAL DUTIES 



SUBTASK 
Z 



D E S C R I P T O .R 



Know and urn niiWrai tMt MiuipmMit 
• ChftractM-Mtics 



• Operation 
0 Know bwic principlet of •••ctronlct 

^ AC/DC th«ory 

2 RLC circuits 

3 Solid tuu principWt •nd circuits* 

4 Tub* principles and circuits 

5 «Mcrowavf principle, dMicMi and circuits 
e Analog tachniquas 

7 Digital tachniquas 

S ^■-') Sarvo systams 

0 AJndantaijd and ^trouWashootlng tadmiquaa 

a Visual chacks ' 
a Elactrical chacks 
, a Oparational tasta 
a Dia^inoctic tacts 
a Analysis 
' a Substitution 
0 Damonstrata rapair tachniquas and procaduras 

a Standards, 
a SoMaring 
a Wirav^aff 
a Ramova and raplaoa 
\." 0 Undarsttnd subaystam interfacing 

a Power Interface 
a Signal interface 
a Mechanical interface 
0 Know and use technical puWicatioos 

0 Demonstrate knowledge of ipecifte subsyrtafna, LRUs 

1 4 Principlas of operation 

2 PerfcKmance standards 

3 Signal flow 

^ ^ 4 Failure modes 

5 AsBOciated ^Mcial test equipment 

0 Demonstrate knowledge of spedfk automate test stations 



Demonstrate knowledge of specif manual taet scatioflk 
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^ Task Dictionary (continued) 

\ FLIGHT. UNE DUTIES 

SUBTASK^^ 

Z DESCRIPTOR 

0 Identify f Uf wy meintmnc* akh: 

1 tools 

2 tni •quipmant * 

3 tipch. ordars, job guktet, ate. 
0 Obtain and raturn maintananca akta 

" j^^aalact ' 
^ : m traniport 
0 Gain/cloaa accav to aquipmant 

• opan/cloaa oompaftmantt 
^ • ramova/raplaca acoan panals/coMling 

0 , ' connact/ditconnact tait aquipmant 

0 Varify malfunction : all 

1 um bite 

2 Parform oparational tasts 

3 Parform viiual chacks' 

4 Parform alactrical/machanical chacks 

5 Parform wpmckMl tact aquipmant diacks 

6 Parform diagnostic tasta/CITS 

0 Evaluata dlscrapancy raport/chack pravlous Mstory 

0 Isotata malfi^nctton/locata fault 

1 Consult tach, ordars/Job guklas 

2 Datarmina from symptoms 

3 Evaluata from BITE/aTS 

4 Evaluata from tast rasuks 

5 Intarprat from analysis only (axparianca & knowladgs^ 

6 Switch and/or substituta 
0 Datarmina^ actkm to ba takan 

a l\k>t rapairattia IF/L-^&r/s m^) 

a RapairaMa (F/L ►M A/C, 8 "»W) 

a Cannot duplkata (F/L-^ND, A/C, S— M() 

0 Parform rapair maintananca 

1 Rapar malfunction (wiring, comiactors, atcj 

2 Parform minor maintananca 

0 Sarvioa (lubricata^ claan, praasuriza, atcj 

0 Calibrata/align v 

0 Adjust 

0 Obtain/raturii raplacamant unit (LRU« SRU, atc.^ 

0 Ramova/raplaca safaty wkas/bonding straps 

0 Diaconnact/ramova/install/connact 

1 *V/ LRU 

2 SRU 

3 Componant ^ ^ 
0 . • Racord maintananca actkms/rasults ^ 

a MDC forms (schaduM/unachaduM) 
a Maintananca logs 
a E^ipmant logs 
f Supply forms 
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Task Dictionary (continued) 



SHOP DUTIES 
0"TY TASK SUBTASK DESCRIPTOR 



02 . 01 0 Ictontlfy mommnf nwintmncc «Mi 



2-: 

3 
4 



15 



10 



2 ^' tMt tquipnMnt/tMt station 

3 tsch. ordm. K>b guidtt, 

02 0 OIKain and rtturn maintananc* aidi 

• Salact 

• trantport 

03 1. Gain/dOflB acc a M into aquipmant, unit, ate. 

17 0 Tait oparation of banch chack aquipmant /taat Hatlona 

04 0 ponnact/Diaconnact taat aqutpmant/itatkina 
06 o/ . * VarifY matfunctton; , all 

r ^ ^ ••'^^ 

Parform oparatk>nal taats 
>arlorirt viwil diackt 
R«irform alalBtriaal/niMtii(o)^ aM^ v 
g "i^orm apMial laat aqiiiiM 

Q Parform d ta f n o it te taataAlStTS . « * ' 

06 0 E^aluata diacrapancy r^ponfdtm^ P^*o« hfitprv ^ 

07 0 laolata matfunction/tocatA f^^tlf. ; 

* - Conault.ta^. ordarWIM» ff^ldfi - 

2 Dttarmina from aymptbiiir'^ ^ vV/v/'/ 

3 Evahiata from BITE/CITS :, . i> .^ ' rjy 

4 Evaluata from taat raauHa * > 
g Intarprat by analyai* only (axparlanoa/knowiadia) 
Q SwKch and/or aubatKiita untta 

06 0 Datfrmina action to ba takan 

• Not rapatraWa (8. NRT8, N) 

• Rapakabka (S. W) 

• Cannot dupUaata (8. K). 

13 0 ObUin/ratum raplacamant unit (LRU*. 8RU. atcJ 

06 0 Parfofm rapair maintananoa 

1 Rapair malfynetlon (aoMarino. wMit. ola.) 

2 i^orffi minor maintananoa 
0 * "bbconnact/ramova/install/connact 



/ 1 LRU^ 

2 " SRU 
' 3 Componant 

0 Sarvioa (lubricata. daan. pravuriza. ate.) 



11 0 Calibrata/AII«n 

12 0 Adjuat 

18 / 0 Varify rapair of matfunction/maintananoa prooadura 
10 ^ 0 Raaord maintananoa actions/ratults 

I • i^lOC forms (schadulad/uhadiadulad) 

• Maintananca logs 

• Effuipmaht k>gB 
^' . 9^ Supply forms 

19 .0 ^ Inttiata disposition of aquipmant 

Sand to supply as raady for isaua 



Sand fo supply for dapot rapair 



Task Dictionary (continued) 
AVIONICS SUPPORT EQUIPMENT REPAIR DUTIES 



TASK SUBTASK ,^ ^ « « „ . » . 

YY, Z DESCRIP T^O R 





0 


01 


0 




1 




2 




3 


02 


0 


03 




04 


0 


06 


0 




1 




2 




3 




4 




5 




6 


06 


0 


07 














• 3 




4 




5 




6 


00 


0 




1. 




2 


10 


0 


11 


0 


12 ^ 


0 


18 


0 


16 ^ 


0 



D«t«rmiM action to \m tiktn 

• Not rtpairabto (wnd to alibratlon faeUity. ctcl 

• Rapairabia 

• Cannot duplicata 
Idantify naoanary maintananoa aidi 

Toolf * 
Tatt Equipmant 
Tach ordan. Job guidaa. ate 
Obtain and raturn maintananca aldi 

• SalM:t 

• Trantport « 
Gain/doaa acoaa into aquipmant, unit, ate. 
Connact/diaconnact tatt aquipmant 

Varffy malfunction 

Uaa BITE s * . " ' ' 

Parform oparattonai tacit . • • ' 

Parform vltuAl ctiackt ' ' 

Parform atoctrical/madianicM cbaekt , ' 

Parform ^laciai tatt aquipman]^ diaGlv ' 
. Parform diagnoatic tatt/eVjrS ** > 

Evaluata d^crapancy' raport/chacK pravlowi Matbry f ^ 
..ikHata milf unction . ^ , : ■' 

^ ' ContuK tacK ordafyjob giiMpt . 

Datarmiria from tymptomt' . • 

Evaluata from* $ljrE ^ 
^ Evaluata from tatt .iratuNt ^ _ 

Intarprat by analyiitMMily (wpariaoca and fciMw^^ 
Swftch. and/or MjfaaHcyta an^ 
Parform rapair maiittan^nc* * • 
Rapair malfunction 
•Perform minor maintanpnca. 
. Sarvioa (lubricata. daan; pratturlza; ate.) : v V 

Calibrata/align ' . .• 

Adjuti ^ ' .'^ ^ " \ .. ^ ■ ; ; ' . ■■'::.^;:V' 

Varify mainiaiurhca VocaduraAapairi/milfunctkm ; 
Raoord maintanahba actipna/raiMiItt 

.' • MDS foisrni • 

• Maintananca loga 

• SquipffiUnt k>9i' .■ .' 

• Supply /orma . ' ' ^V-^- 



Task Dictionary (continued) k 
FLIGHT LINE SUPPORT EQUIPMENT DUTIES 



DUTY TASK SUBTASK 
XX YY ? 



DESCRIPTOR 



V 



04 01 0 Idtntify mc—iry nnMintmnc* aidt 

'4 $jupport •quipnwnt (SE) 

.02 0 Obtain and raturn nwlntafianoa akk 

^ • Sal«ct^ I 

^ . • Tranipbfft 

• Poiition 

20 0 Oparata wipport aquipmant (SE) 

• Inipact SE 

• Connact/dtabonnact . SE . ' • \; 
" • Turn on/tum oM ; v- .V' .' 

• Monitor 

il6 0 Racord maintananoa actiona/raauiti 

• Maintain SE racorda/looi 



"^5 -..^S^k: 



'-■■is::' 
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Task Dictionary (continued) 
GENERAL NON TECHNICAL DUTIES 



DUTY TASK SUBTASK o o . « -r « „ 

XX ' YY Z DESCRIPTOR 

■ ' % , . . ■■ N . %y- . 

O*./ BO . -0 > ObwrvfL taftty prMutlom and r«quirimnts 

^■-y • Qsnml tlvctrkal nffMy. .r 

Q«n«ral lircrift nfvtjL'!^ , ' 

• Equipfmnt pscullar Mf«ty 

0 Obm}m .mtur\ty prMutkm ind raqukMiMits 

• Docurmnt a»ciiHty 

• Equipment iKurity 

• Bam McUrity 

• NudMr atcuritY 

B2 0 Um data documantation tyitaim 

•^^..Miintananea date oollaction tyttam (MDC8) 
9j Equipmam/maintafunca lo9i ami raports 
a Aircraft logs aiMfraports 

&3 ^rO Undartland/iiaa tupply lyttam 

a Supply prooadurat 
Supply documantation 

54 0 Oambntftrata familiarity wHh malntanfenca onQMiixatibn polldai, 

ooncapts, and procadurat for: 
a FHght lina " 
a Shop 

56 0 Damohttrata familiarity "with aircraft: 

' ' • Purpo«a/mMon 

a Equipment locations ^ 
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Task Characteristic Parameters /Values 
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Appendix B 

TASK CHARACTERISTICS .. . 

Task Criticality ■ 

■ ^ 

It is necessary to evaluate each. task/function \Kithin a main- 
tenance "event with respect to criticality. Inevitably, almost all tasks 
avre of a high level of criticality in insuring the ultimate success of 
a mission. However, as the training of personnel to perform taSiks 
is lan end in itself, the tasks may be assigned individual levels of 
criticality within the context of each event. There are three levels 
,,pf t^sk .criticality used for TRAMOD ojperation. They are defined as 

■ ;jf Level Definition : *\ 

1 \^ Non-ci^itical - tasks that, if no| performjed correctly and/or 
to standards, would not degrade the overall effect ivelless of 
l'^. the event, but which might affect the 'effjdiency of the^pejs- 

formance (e. g., for the event ON -AIRCRAFT MAIN'TE-- 
NANCE, the functions of the task "obtain tools and test 
equipment" might be incorrectly done ip^that insuffidient or 
wrong tools, etc. , are brought to the a^ircraft, so tt)%t 
^ another trip for tools i.s necessary). 

3 Semi-critical - tasks that, if not performed correctly and /or 

to standards, woifld rrot substantially degrade the effective- 
ness of the maintenance ^vent, but which, if performed 
correctly and to standards; would leacl to an efficient and 
effective overall maintenance event performance (e.g., for ^ 
the event ON-AIRCRAFT^ MAINTENANCE, the task "connect 
t „test equipment" might be, performed i^cOJrrectly so that invalid 

1' ' measurements might bemads, resulting in a need to, repeat the 

* event or a reduced equipment/system capability. 

' ^ Critical -Wasks that, if not performed correctly and to 

* standards, would seriously affect the^effectiveness and 
success of the maintenance event (e. g. , for the event Oj/- - 
AIRCRAFT MAINTENANCE, the incorrect performance of 
task "perform verification tests" may allow a serious de- 

: gradation of equipment performance to go unnoticed). 

0 \ Not-applicable - tasks that are not applicable to a given 

equipmrient or system. This desijgnation may be used by the ' 
computer to allow it to bypass the other input characteristic 
parai^eters. . ^ 

'59 . 
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. Task Characteristics (Continued) 

Lea rift p if faculty 

^ ^'^^^ learning difficulty of a tas^/function may be expressed as 
Si^ function ujf the time it takes to learn to perform the task relative to 
the population of learning times across- all tasks associated with the 
same system.. This relationship is convenient and sufficienf for the 
purpose 'at hand. However, its limitation is realized as is the fact 
that the time involved in the learning process is a function of the < , 
interaction of many variables including effort, complexity, and 
practice'. Although levels of task difficulty provided by recent USAF 
bccupalfcional surveys are based on a scale of one to nine, for the 
purposes jof this data base; five levels were used. THey are defined 
as follows: . . , 

Level Definition ^ ^ 

1 Extremely low - v^ry much les^ than the mean value for ' 

learning times across all tasks associated with the subsystems 
studied. 

^ i Low - somewhat less than the mean value for learning times 

across all tasks associatecf:^with the subsystem studied. 

3 , Average - approximating the mean value for learning times 

across all tasks associated with the subsystems studied. 

4 - High - somewhat more th^n the mean vaiue for idjarning times 

^ across all tasks associated with the subsystems studied.^ 

5 . Extremely High - very much^more than the mean value for 

learning times across all tasks .associated with the sub- • • 
systems studied. 

Task Frequency 

; ■ - ' ■ . \ 

" Frequency of task/function occurrence is a measure of the 
exposure time of a trainee to each task he encounters when per- 
forming his duties. For the Shop, Flightline, and Support Equipment 
maintenance duties, the exposure time is obtained by exercising the 
following equation using reliability Ind maihtairiability data/estimates 
fo. Hie subsystem studied. 

MTTR by Maintenance Event 

. ^ ■ ' — 

MFHBMA 



• \ - Task Characteristics (continued) 

.•where: ^ . • . * 

. MI is the maintenance index of the time taken to perform a 
^maintenance action on a given subsystem for each flight ho\ir 
of operatipri. 

MTTR is the mean tim^ to repair (i. e. , complete a specific 
event required as part of a -maintenance action^ given that a ^ 
maintenance action is requiired. This value, is calculated by 
multiplying the average time it takes to perform a task event 
by the probability of occurrence of that event. 

MFHBM:^ is the mean flight hours between maintenance 
actions. ^"^^^^^^^^ ' - ' 

Five levels are used to record itask frequency for TRAMOD 
operations. These values are obtained from the maintenance index 
values (Mis) of, the subsystems fdr.each, maintenance event combina-- 
tion that requires the tasks of interest to be performed. Each of the 
"MI levels are defined in relation to the MI rate of like *tasks across 
all the subsystems studied. The scale uised to obtain the leyjgls 
represents -thi^ linearly partitioned relative weighting of the'lbgarith- 
mic values of the IVHs. In other word^, the logarithrrfic- values of the 
Mis were diyi)ied into five discrete increments to obtain their relative 
level across subsystems as defined below; . 

Level Definition,; 

1^ Extremely^Low. - Task, is performed infrequently 

2 ^ Low - Task is performed at a rate less than the average 

3 Average - Task is performed at the average rate 

4 High - Task is performed: at a rate above the average 

5 \ Extremely High ■ Task is performed frequently * 

Task Psychomotor Level — 

Each task/function of a maintenance event entails sjpme level ; , 
of conscious, physical action in response to sensory inputfl^^;^^The 
degree of visual acuity, reaction tijne, manual dexterity, mtiltiUmb 
coordination, finger dexterity, arqpi -hand steadiness, contr6|j, ; 
precision or interactions of any of the above psychomotor facMrs, as 
mes^sured by the amount of practice required to learn^;and applj^. each 
t^sk, were chosen to serve a« bases for evaluating task levels. ./\s no 
suitable specific taxonomy exists for either defining or measurini^^the 
. psydhomotor levels of a maintenance task, a measurement criterid^, 
presented below, was constructed to serve the needs TRAlJlQD ' 
operation. An attempt is made to clarify the definitions by exanlple. - 



» Task Characteristics (continued) 
Level 'befinition 



^ 1. . Imitation - Task demands little or no practice to perform.^ 

Only routine motor skills and perceptual discriniinations are 
needed.* Task performance may reqxfti^e instruction and 
'illustration for a few simf>le parts [e. g. , obtaining a piece 
of test equipment, using basic hand tools, noting whether or 
not' a light, is on, reading values on a sihnple dial, activating 
a button, knob, or switch]. 

2f Manipulation - Task requires some practice either to - 

integrate routine motor skills and perceptions (e. g. , turning 
, ^'s witch on when a dial indicates a, particular value) or l6 • 
peMect certain motor coordinations or>perc^tual discrim- 
inations (e. g. , fastening or removing a spring clip, notyig** 
relative motions of a dial or scope presentation, perfoj^mihg 
minor maintenance or servicing procedure^, operating test 
equipment). Task performance may be completed for the 
most part without assistance other than reference material. 
Speed is not critical. , ^ 

'\ 3 . Precision - Tafek requires moderate practice to perfect or 
' » . integrate the^perceptual motor skills. Task performance 
'demands^the ability to do all parts of the task (at minimum 
recommended level) unassisted witK rea3onable speed and 
. accuracy. Inspection/ verification of performance may be 
necegsary (e.g^ , assembling electrical/mechanic 
soldering, performif>g electrical, operational, or diagnostic 
' checks, performing routine repairs, LRU or SRU replace- 

^ ment). . * / 

. 4 ' . Artic^latibri - Task requires much practice to acquire the 
motor cqordination and/or perceptual discriminations 
• .y necessary ^or proficient perfornriance in all activities of all 

parts pf ihe-t High accuracy but not neeessarily M / 
speed i^f needed (e. g. , performing rhajdr electronic/ 
me;phanical ,Aali^^ 

5 NaiuraliTfal^i^ - Task requires a great deal of practice to 

V r V. a^uire,^e motor coordinations, and p^iicept^al diserimina- 
--tidns K^6^^^ performance. Task recjuires 

^ skill production 

' ' of reference materials (e, g. , performing. . 

fi^l' /* 1^ wiring, precision machining, per- ' 

. t /r*^f^i^l^ critical emergency repairs pr shutdt}wn procedures). 
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Task Characteristics (continued) 
Task Cognitivef Level ' • ♦ 

♦ • ' 

. Each task/function within a niaintenance event may be i- 
described in terms of the relative cognitive (knov/ledge)^ level neede.dr 
by a person to learn or perform it. As no suitable specific taxonomy 
exists for measur;Lng thfe cognitive ljevels>requir^^ of a technician 
performing a'rnaintenance task, .a measurement criteria?!., presented 
below, was constructed to' serve the needs of TR A MOD. These \^ 
definitions are derived from a combination of the Specialty Training 
Standards (STS) proficiency code definitions and Bloono^ (tleferenc^ 
1) cognitive level definitions. An attempt is made to clarify the 

definitions by example.. The five levels assigned are: 

* . . . . ' ■ t 

Level Definition ' . J ' 

1 Comprehension - task requires that basic, facts and ncJmen- ^ 
clature be known for successful perforn?ance («.^g. , names 
of basic tools and test equipment; how to read text materials 
and use visual maintenance aids; know special tern^unology 

' and vocabulary associated with a job specialty)., . ^ 

2 • Application - task requires that the principles and procedures 

involved be known and used for successful performance (e. g. ' 
using basic tools ancjifest equipment; performing operational ' 
or diagnostic cftecks using good maintenance aids). 

' ' ■ ■ :^ 

3', Analysis task requires that operating principles be under- 
stood and an ability to draw rudimentary conclusions 
concerning the subject matter. Technicians should be able to 
evaluate the relevancy of data (e.g.", performing fauJ.^solation 
and troubleshooting, performing calibrations or alignments 
without step-by -^step -maintenance aids). 

4 Synthesis - task requires that'considerablfe theory be 'known 

and an ability to evaluate conditipns (e. g. , evaluating test 
results properly in terms of the theory of operation). " ^| 

. 5 ' Evaluation - task requires. all of the,a:bove abilities pluis 'that 
of making predictions or decision^ requiring a complete \ , 
understanding of underlying theory (^.g.^ determining what j | 
caused a subtle problem an^ cLeciding the changes that mi#t 
be made to insure suc-cessful event completion ot non-'' '0" 
recurrence of the problem). ^) ^ 
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Acronyms. 
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aVd 

AFSC 

Arc ■ " 

BIT 

CITS ' 
DAIS 

, ISP * 
LCC 

LCCIM - 
CRU 

. mi/iH * 

l^TTR 

R&M 
RMS. 
RTU 
SE , 
SRU 

TRAMOD 
-TTS 



Appendix C 
ACRONYMS * 



analog to digital 
air .force specialty ccide 
air training cbmrnand 
built-in-test ' 

central integr'ated test system" 
digital avionics information system " 
cannot duplicate discrepancy * 
instructional systems development 
life cycle cost - ' 

cycl^ c6'st ihiparct model 
line replaceable unit 
maintenance man hours 
mean tim-e to repair , 
on -the- job. training 
reliability and maintainability 
root-mean-squarre ' 
remote terminal unit 
support equipment , 
shop replaceable unit 
training -requirements analysis model, 
technical traihing school ' 
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